Skip to content

Conversation

@gordon-lim
Copy link
Contributor

@gordon-lim gordon-lim commented Dec 5, 2025

Notion ticket: https://www.notion.so/cleanlab/Mutative-tool-fallback-responses-2c0c7fee85be80b19645df046150bc08?source=copy_link

This PR re-introduces mutative tools by fixing the issue of guardrailed responses after mutative tools => user doesn't know that mutative action was done.

Example of issue:
example of guardrailed response after mutative tool

Fix is to have the develop provide a template fallback for each mutative tool. If final response is guardrailed, collate the fallbacks for each tool into one response e.g.

image (Final assistant response was guardrailed)

TODO: Codex backend needs to be updated to take the developer's fallback response and show that instead of the Cleanlab fallback to maintain visibility. That will be fixed by this ticket: https://www.notion.so/cleanlab/Mutative-tool-fallback-responses-2c0c7fee85be80b19645df046150bc08?source=copy_link

@gordon-lim gordon-lim marked this pull request as ready for review December 6, 2025 03:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants